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TO TEST THE RELATIVE EFFECTIVENESS OP 3 TRAINING 
FRCCECURES POR ACQUIRING A TEACHIW SKILL, EACH APPLYING 
REINFCiRCEMENT PRINCIPLES, STANFiDRD TEACHER INTERNS WERE 
VICEOTAFEC C44 4 OCCASIC<NS DURING THE FIRST 20 MINUTES OP 
CLASS. EACH INTERN SAW A VIDEOTAPE PLAYBACK WITHIN 3 DAYS 
(NEW LESS:44S l^RE VIDEOTAPED WITHIN 2 BAYS AFTER PLAYBACK). 
REINFiDRCEMENT TRAINING WAS THE VARIABLE, WITH THE PREDICTED 
ORDER OP EFFECTIVENESS GOING FRC4( SELF-ADMINISTERED FEEDBACK 
TO EXFERUCNTER-ADMINISTEREB FEEDBACK, TO EXPERIMENTER 
ADMINISTERED FEEDBACK WITH CUE DISCRIMINATIC<N TRAINING. A 
COUlPrx. GROUP AND THE FOLD:Wlr«> 3 EXPERIMENTAL CRZifFS FCRMED 
WERE— (1) SELF-FEEDBACK CROUP (S-F) U4STRUCTEB IN THE 
EDUCATICtML RELEVANCE CP INCRCASM STUDENT PARTICIPATION, 
DEFINED IN TERMS CP PUPIL FARTICIPATICN RESPi:4(SES (FPR) , WITH 
■EMPHASIS ON IMT-IEOIATE REWARD CP FFR’S (PLAYBACKS VIEWED 
ALOrC, EXAMPLES AND A RATIfJG CHART PROVIDED) , (2) 
RElNFORCEr4ENT-C44LY CROUP (R) RECEIVED THE SAME INSTRUCTIC4JS 
AS S-F (VIEWED PLAYBACKS WITH AN EXPERIMENTER, WH3 REINFC«RCEB 
INTERNS* REINFORCEMENT OF FPR’S), (3) REINFORCEMENT AND 
DISCRIMINATION TRAINING CROUP (R AT4D D) RECEIVED THE SArC 
INSTRUCTIONS AS S-F (EXPERIMENTER SERVED THE SAf£ FUNCTIC44 AS 
FOR R AND ALSO GAVE DISCRIMINATION TRAINIf^C INCLUDING CUES, 
SUGGESTIONS, AND POSSIBLE EFFECTS). RESULTS WERE ANALYZED BY 
ANALYSIS OF VARIANCE, T TESTS AND MULTIPLE REGRESSION 
ANALYSIS. PREDICTIONS WERE BORNE 0<UT. SUGGESTI044S FOR FUTURE 
STUDIES AND FOR IMPROVEMENT OF SELF-FEEDBACK ARE INCLUDED. 
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The C: '^’.'evifaent described nere applies .well knovn* principles of reix)- 
fcrcerijcnt theory of e training problem. The training paradigra ravolv^es 
applying a reinforcer to an emitted response. The prediction is that the 
rate of responding will increase. 

IVo aspects of the training procedures do> howeverj depart from those 
typically used In reinforcement studies. Firsts the reinforcer is not 
given while the learner is actually emitting the response. In this study, 
the subjects were videotaped while emitting complex responses (teaching) 
soise of which were to be reinforced. After the actual behavior sample 
v/as collected the subject viewed his perfonaance in the presence of an 
exper iraente t . When the desired responses appeared on the videotape, the 
experimenter reinforced their occurrence. If results similar to those 
obtained in other studies occur in this situation, reinforcement concepts 
are widely applicable. Also training procedures or complex skills can be 
developed which use these principles and concepts in ways directly 
analagous to the procedures used in laboratory studies where the utility 
of these concepts has been amply demonstrated. 

The second characteristic of the training procedure which departs 
from the usual laboratory methods is that the behaviors to be learned 
occur in the context of many other behaviors and are relatively iuore comple 
than operants conditioned in laboratory studies. They are more analogous 
to the kinds of behaviors chat h.ave been verbally conditioned on psycho- 
therapy sessions. Here, as in these other complex verbal interactions, it 
is literally impossible to reinforce every instance of the operant being 
conditioned. The Immediacy of the reinforceiaeat, for similar reasons, is 
also somewhat variable. Again, if comparable results are obtained, the 
generalizebility of reinforcement concepts is supported. 

Since the subjects in this experiment are htimans it was also 
possible to test the efficacy of a cue discrimination procedure. This 
procedure consisted in pointing out to the subjects those cues to "diich 
the reinforced operant was attached. In this way the cue- resDonse chain 
is clearly indicated which should be facili taring. 
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Since human subjects are being used, it Is also possible that they 
can reinforce themselves or, more generally, provide their o^-m feedback. 

This can easily be done with videotape recordings of a behavior sequence 
since the subject can view himself as a behaving organism. With instruc- 
tions he can note the presence or absence of the desired response. 

Hov/ever, it is dubious if such a procedure is likel}.' to be highly 
facilitating since the subject may not attend well, may be easily distracted, 
may be highly subjective in his viewing. The effectiveness of this train- 
ing procedure remains to be tested, hov/ever. 

This experiment, then, tests the relative effectiveness of three 
training procedures, each representing an application of reinforcement 
principles. The three procedures represent points on a continuum from 
self- administered feedback or reinforcement to experimenter-administered 
reinforceraent with cue discrimination training. 

The prediction is that the order of training effectiveness will be 
in the same direction, with the self -administered feedback the least 
effective and the experimenter- administered feedback with cue discrimin- 
ation training the most effective. 

An assumption was made that the behavior being learned by the trainees, 
reinforcing student participatory behavior, will in turn increase the 
frequency of this behavior. Although the experiment is not designed to 
test this assumption, it is supported by reinforcement theory, and corre- 
lational data relevant to the assumption is presented here. Uiilike the 
experimental situation, the teacher administers reinforcement as the 
behavior occurs, approximately more closely, therefore, the operant 
conditioning paradigm. 
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EXFERlit<iENT 1: DRAFT ONE 

METHOD 

General Procedure Intern teachers were videotaped on four separate 
occasions during the first 20 minutes of regular classroom lessons. In 
the intervals between each of these taping sessions they received differ- 
ential feedback as part of their regular supervision. The treatment or 
supervision sessions were alike for all subjects in that they viewed 
videotape playbacks of their earlier teaching performance. The mode 
and amount of feedback given each intern was varied by manipulating the 
reinforcement and discrimination training provided by an experimenter. 

Before the pretest videotapes were recorded, all subjects were told 
when they would be taped and were asked to present a discussion- type 
lesson in vdiich teacher-pupil interaction could be observed. This was not 
a new or unusual experience for them as they had been frequently exposed 
to the videotaping -playback-supervision process during the previous three 
months of the Stanford Intern Program. 

Pupils in each of the classrooms were informed by the interns before- 
hand that the portable TV equipment would be present in the room, and that 
the cameras would be focused on the teacher, net the class. 

Treatments : Mode of feedback, type of reinforcement and amount of 
discrimination training were varied for four experimental groups of interns. 

Controls: Group (C) ; At the beginning of the first playback session these 

subjects were given written Instructions which suggested that as they 
viewed subsequent playbacks of themselves, they try to determine their 
effectiveness in relation to: the aims of the lesson: use of examples; 

effectiveness of teacher questions; amount of pupil participation; pacing 
of che lesson, and teacher-pupil rapport. Following this, they viewed 
the first and all subsequent playbacks alone. E started the machine and 
left the room. He returned as the tape finished, stopped the machine 
and told the intern when to expect the next taping and the date for the 
following playback session. As for ail subjects. Group C (controls) 
viewed playbacks of the preceding lesson within three days of its taping. 
Lessons were videotaped Td.thin two days of each playback session. 
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Self-Feedbacic: Grou? S-F ) ; These subjects foUox^ed the same basis schedule 

as the controls, except that they received a different set of written 
instructions. The instructions discussed the educational relevance of 
increasing pupil participation in certain types of lessons; defined pupil 
participatory responses (PPR) as a clearly observable non-verbal or verbal 
response that was considered desirable; and provided brief examples of 
such behavior. It was also suggested that the intern immediately reward a 
PPP. when it occurred as this would tend to increase pupil participation. 
Examples of teacher responses - both verbal and non-verbal x*7ere tnen 
provided. Finally, a simple rating chart was attached so that the intern 
could classify his responses to PPR-s as "teacher rex/ards"; 'teacher ignores* 
'teacher punishes"; or "can't classify.' As with the control group, self- 
feedback subjects viewed each playback alone. 

Reinforcement-Only Subjects: Group (R): These interns received the same 

vrritten instructions as those in the self-feedback condition. However, £ 
viewed each of the three videotaped playbacks V7ith them, and verbally 
reinforced all observable instances of these Group (R) interns reinforcing 
PPR's. Whenever the intern was observed to reinforce a PPR, E responded 
by saying "Goodl" 'That's it." etc. Beyond this, he did not comment upon 
the intern's teaching performance. 

Reinforcement Plus Discrimination Traininp:: Group (R D) ? These interns 

were first given x^^ritten instructions xdiich x^ere identical to those 
administered to Group (S-F) and Group (R) subjects. In viex7ing subsequent 
playbacks with them, E provided differential reinforcement as in the 
Reinforcement-Only treatment. In addition, he provided discrimination 
training. This consisted of pointing out salient cues to xThich reinforce- 
ment should be attached, suggestions related to the immediacy, affect 
loading and types of reinforcement the teacher could use, and finally, the 
effects of such behavior upon pupil participation. In general terms, than, 
it wight be said that Group (RvD) subjects received 'maximum supervision,' 
and Group (S-F) subjects received "self -supervision." 
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Experir.iental playback sessions for all groups were thirty minutes 
in length. When E viewed playbacks with Group (R) and (R:-D) subjects, he 

reduced the sound momentarily when providing discrimination training, and 
spoke over the tape when providing reinforcement. Interns in all groups 
were informed that they could have the tape stopped or reversed and played 
over again at any point during the playback. Playbacks were stopped 
occasionally by E when he was working with the supervised groups. However v 
since the sessions were limited to thirty minutes » only one or two brief 
stoppages in sessions two and three were possible. 

Subjects : 

All Stanford intern teachers majoring in English, Social Studies and 
Mathematics were included in the study. Approximately equal numbers of 
interns from each of the subject-matter areas were assigned to each group. 

In addition, groups of interns teaching in the same school were distributed 
throughout the four groups. In this x^ay, systematic bias due to subject- 
matter major or pupil characteristics based on socio-economic status was 
avoided. The major characteristics of the sample are summarized in Table I. 
See Table I, Experiment I). 

The Dependent Variable : 

The dependent variable was defined as the relative frequency with 
which the teacher positively reinforces pupils participatory responses 
during teacher-pupil interaction in the classroom. PPR's were defined in 
training sessions with the interns as any desirable or relevant pupil 
comment, answer or question. For purposes of measurement however, desir- 
ability and relevancy were not considered. 

The basic strategy in defining the dependent variable involved 
classifying teacher responses into one of four major response categories. 
These include positive reinforcement, negative reinforcement, interaction 
and information giving responses. Pupil responses were also classified 
and considered in relation to teacher responses. Each of the above 
response categories are defined in the following discussion. A summary of 
the classification theme appears in Ta.ble 2. (See Table 2, Experiment. I). 



Teacher Positive Reinforceiuent : 



A teacher response was defined as positive!*, 
reinforcing it, met one of two conditions. First, the response had to 
immediately follow a PPR. Secondly, it had to be classifiable under one 
of the following response categories. (1) Teacher Positive Verbal 
Reinforcement (*!- VR) : Immediately following a PPR, the teacher uses vjords 
and phrases such as 'Good,’”‘Fine I"(2) Teacher Positive Non-Verbal 
Reinforcement (-^NVR) . The teacher in responding to a PPR, nods, smiles, 
leans or moves toward the pupil, or writes the pupil's response on the 
blackboard. (3) T eacher Positively Qualified WR ) and (4) Post Hoc 
Reinforcement (PHR) . The teacher emphasizes positive aspects of pupil 
responses by reorivinting class attention to earlier contributions by a given 
pupil (PHR), or by differentially reinforcing the acceptable components of 
partially adequate response (-I-QR). 

Teacher Negative Reinforcement : A teacher response was defined as nega- 

tively reinforcing it immediately followed by a PPR, and was classifiable 
as the obverse of one of four types of reinforcement outlined above (-VR; 
-NVR; -QR). 

Teacher-Pupil Responses Independent of Reinforcement Classifications ; Certain 
responses that occur frequently in interaction and yet are not classifiable 
as some form of reinforcement were included in the definition of the 
dependent variable. These included information-giving by the teacher, 
teacher initiated interaction (i.e., questions directed to a given pupil 
or to the class in general) pupil initiated interaction (i.e.> volunteered 
comments or questions), teacher no response and pupil no response. 

In general, the dependent variable included evaluative and informa' 
tional signals which the teacher may use in the classroom. There vyas a 
cendancy to emphasize socially rewarding operants since it could be 
axpected that such behaviors would tend to increase pupil participation. 

Both In the training and measurement phases of the study, the PPR 
was presented as an which served to cue the teacher or rater that a 
desirable (or classifiable) teacher response was about to occur. 
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MicasurciTtent Proced uves ; Fouir videotapes for each intern in each group t-;ere 
analyzed by raters trained for this purpose. Throughout the rating phase 
of the experiment, they worked on the tapes in a random order so that they 
neither knew the treatment condition nor the number of the teaching trial of 
the tape being rated. Operators ran the television equipment and selected 
tapes using a list of random numbers. 

In addition to recording the frequencies of each of the behaviors 
defined as components of the dependent variable, the raters recorded other 
relevant behaviors and lesson characteristics as well. Frequencies \;ere 
recorded for the total number of pupils who responded, the number of 
responses they emitted, and the sex of each responder. The raters also 
recorded the length of each videotape to the nearest tenth of a minute, 
and determined how much time was spent in discussion, group work or 
individual study. 

The Unit of Measurement : In analyzing pupil -teacher interaction, one may 

record discrete responses, or measure in terms of some unit such as the 
uninterrupted utterance, or the spoken sentence. Both systems of raeasure- 
loent were used in this study. A single pupil response was defined as an 
uninterrupted utterance. Raters were trained to define an interruption as 
a comment or question. 'Partial’* responses that teachers commonly emit 
during pupil speech ("um-hum"; "Yes,”; etc.) were not defined as interrup- 
tions. All forms of verbal and non-verbal reinforcement were scored in 
terms of discrete responses. For example, if the teacher said, "GoodI"; 
"Good"; ’That's finel", the rater coded all three operants. 

Training of Raters ; Eight raters were initially given intensive training 
on intern videotapes. Once they had achieved at least 90% Interrater 
agreement on all of the raajor response categories, and better than 95% 
agreement on teacher reinforcement responses, the analysis of experimental 
tapes was begun. Reliability was maintained throughout the analysis by 
scheduling frequent joint rating sessions where raters checked the per- 
centage of agreement and referred to definitions of relevant responses so 
that systematic rating biases would not develop. Neither ratings taken 
during training, nor those produced in the joint sessions were used in the 
statistical analysis of results. 
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The ratings upon which the reliability coefficients reported in 
Table 3 are based, v;ere acquired in the following way. As each block of 
30 or 40 tapes were completed, (a total of 269 v/ere actually rated), each 
of the six raters v;ho did the bulk of the rating then rated a given tape. 
This was done without the rater's knowledge. Eight tapes, two from each 
trial, and two from each group were rated by all six raters in this way. 

As can be seen, interrater agreement Is high. (See Table 3, Experiment I) 

A certain amount of data was lost between initial videotaping and 
the final statistical analysis. Some tapes were technically poor, and 
could not be rated. Some tapes were inevitably less than the required 
20 minutes, and were also omitted. However, if a given tape was ever 
15 but less than 20 minutes, the obtained ratings were prorated to bring 
them up to the 20 minutes criterion. Of the initial 284 videotaped lessons 
then, 25 were omitted at the outset, and 51 tapes were prorated before 
statistical operations were performed. The T statistic was used to 
determine whether or not certain cells in the matrix were biased by the 
inclusion of a disproportionate number of adjusted tapes. T was non- 
significant. Omitted and prorated tapes are shown by group and trial in 
Table 4. As can be seen, they are scattered throughout groups and trials. 
(See Table 4, Experiment I) 
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RESULTS 

Three types of analysis were perfonaed upon the data. Analyses of 
covariance were employed to test for the significance of differences 
between each of the groups (treatment differences). In addition* T tests 
were used to determine the significance of differences within a given 
group from one trial to the next (training differences). Finally, a 
multiple regression analysis was performed on all of the major response 
categories in order to determine significant relationships among these 
teacher-pupil behaviors. 

Treatment Differences ; Positive teacher reinforcement constitutes the 
major response category of the dependent variable. Using trial one scores 
as covariants, the groups were found to be significantly different from 
each other. The data in Table 5 sunnarize these results, and show that 
the differences were significant for both positive verbal (p».001, .005 
and .025 for trials 2, 3 and 4) and non-verbal reinforcement (p.» .025 
and .005 for trials 2 and 4). (See Table 5, Experiment I). 

When the two types of positive reinforcement are taken together, it 
can be seen that the R+D group outperformed all other groups. These 
relationships are illustrated in Figure I. (See Figure 1, Experiment I). 
Positive verbal and non-verbal teacher reinforcements are presented in 
terms of unadjusted mean frequencies for all trials and groups. 

Negative verbal and non-verbal teacher reinforcement occurred infre- 
quently throughout the groups. T^ble 6 shows that all three of the experi- 
mental groups consistently emitted fewer negatively reinforcing responses 
over trials while control group responses increased. These differences 
appear to be fairly stable, but do not reach an acceptable level of signifi- 
cance. (See Table 6, Experiment 1) Figure 2 illustrates group trends in 
negative reinforcement. The data here are also based on unadjusted treat- 
ment means. (See Figure 2, Experiment I) 

Training Differences : Table 7 summarizes the significance levels obtained 

when within-group treatment means were compared using the T statistic 
C'liner, 1962, pp. 65-60). As can be seen. Group (R+D) interns signifi- 
cantly increased their rate of positive reinforcement by trial 2 (p^.Ol). 
(See Table 7, Experiment I) They increased from a base rate of reinforcing 
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approximately 50% of all PPR*s to a rate of 76% by trial 2. In trial 4 
the rate dropped to 67%, and this combined td,£h considerable variation 
within the group, produced before and after treatment differences that 
x/ere non-significant (p*.10). However, when trial 1 versus trial 4 
^i^^6i^6nces t^re tested on the assumption that the population variances 
were unequal, significance well beyond the .05 level was obtained 
(required .05 * 2.13: obtained 7 * 4.19, Ferbuson, 1959, pp. 143-145). 

Group (R+D) subjects also increased their rate of positive non-verbal 
^®i®^o*“cement from trial 1 to 2 and following two treatment sessions, 
ended (p * .10) to use less negative verbal reinforcement. 

Increases in mean positive verbal reinforcement and a concomitant 
drop in negative reinforcement can be most clearly seen in Group (R) 
subjects. The higher significance revels result from considerably less 
within-group variation. 

The control group showed no significant within-group shifts in 
reinforcement from trial 1 to trial 4. Note that the self -feedback subjects 
tended to increase their negative verbal reinforcement rate throughout 
treatment. 

Pupil Responses ; What are the probablp effects of the above types of 
teacher training on pupil behavior? To answer this question, total pupil 
responses and relevant component responses were analyzed. A summary of 
the analyses of covariance (Table 8) performed on Total ??jpil responses 
with trial one scores as covariates, shows that shifts in pupil responses 
closely allowed concomitant shifts in teacher positive relnforcemeni:. 

(See Table 8, Experiment I) while the increase inrthe Group (R) pupil 
sanple appears short-lived. Group (R+D) pupils maintain significantly 
higher response levels in trial 4 (p.005) as well as for trials 2 
(p-.OOl) and 3 (p*. 01). These data are Illustrated in Figure 3. (See 
Figure 3, Experiment I) Note that while the control group initially showed 
a higher mean frequency of responses it dropped slightly over four trials. 
Group (R) and (R+D) pupils increased from trial 1 to trial 4. 
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The increase in total pupil responses iicciediately leads one to ask 
whether they are due to increased teacher positive reinforceoient, or 
perhaps more simply, a function of increased questioning by the teacher. 
While it is clear that differential feedback and reinforcement affected 
teacher behavior, it does not necessarily follow that increased positive 
reinforcement as defined here had an affect on pupil behavior. A com- 
parison of volunteered pupil responses as opposed to teacher-solicited 
pupil responses is relevant. If increased pupil responses were lai'<»ely 
due to increased questioning by the teacher then one would detect an 
increase in directly solicited answers, and a decrease or no change in 
pupil volunteered statements and questions. This does not appear to be the 
case. P ratios based covariance analyses of Pupil Volunteered Statements 
(Table 9 , Experiment I) were significant for trials 2 (p «.01) and 4 
(p*.01). Group (R+D) subjects after showiv sharp gains off somewhat in 
trial 3, but rose again in trial 4. Note however that control group in 
frequencies followed a similar pattern while those for groups (R) and 

(S-F) moved in opposite direction. Figure 4 illustrates these trends. (See 
Figure 4, Experiment I). 

Teacher-solicited pupil responses, while obviously related to total 
pupil responses not entirely account for the increases noted. That this 

is so, can clearly be seen in figures 5 and 6. (See Figures 5 and 5 , 
Experiment I) 

Figure 5 illustrates the relationships between teacher specified 
responses and pupil responses in relation to all pupil responses. It is a 
graphical representation of the relevant relation coefficients reported 
in the next section. Mean treatment frequencies of those responses directly 
solicited by the teacher (OSI and DSG-1) and pupil volunteered statements 
and questions (V and V?) were summed for each trial. This sum was then 
divided by total pupil volunteered responses (V+V?) so that the proportion 
of pupil volunteered responses to teacher solicited responses could be 
detenained for each trials Hote that from trials 1 to 4, an increasing 
percentage of volunteered responses contributes to the combined totals in 
Groups (R) and (R+D) while the control group shows smaller increases. 
Self-feedback subjects show a distinctly different pattern. This decrement 
is consistent with their performance in terms of teacher reinforcement. 

I (V + vl) * 

(DSI + OSG-1) + (V + V?) 
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In Figure 6, teacher specified (DSI DSG-I) and pupil volunteered 
responses (V+V?) are presented for the controls and Group (R*i-D). The 
frequencies plotted are based on unadjusted treatment means* 

Finally, it is of interest to consider inter-correlations between 
various response categories of the dependent variable, and total pupil 
responses. The interccrrelation matrix for these relationships is 
presented in Table 10. (See Table 10, Experiment I). These correlational 
data are consistent with the earlier reported results. Teacher positive 
reinforcement was found to be significantly related to total pupil 
responses (0.50) and to volunteered pupil statements (0.46). Teacher 
specified questions were also significantly related to total pupil 
responses (0.56). However, when they are considered in relation to 
volunteered pupil responses, the relationship is very slight (-<*0.07), and 
negative (-0.13) when we consider volunteered questions in relation to 
teacher specified questions i^ich are directed to the class as a whole. 

An initially surprising relationship obtains between total pupil 
responses and negative verbal reinforcement by the teacher (+0.45). One 
interpretation would be that negative verbal reinforcement produces 
pupil attention. In addition, it also probably has feedback value -- it 
will be recalled that "No" and "Wrong" responses by the teacher were 
included in the negative reinforcement response category. 

Discussion of Results 

It is clear that feedback conditions proved to be the most effective 
training arrangement. Perhaps of greatest interest are what appear to be 
these variations in feedback which are most effective. Clearly, adding 
cue discrimination to the training method substantially improves the pro- 
cedure. This procedure is, however, the most "costly" in that it requires 
the active involvement of the experimenter to describe salient cues and to 
suggest ways of reinforcing participating behavior that the subject could 




use. 
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Variations in the effectiveness of this procedure might occur when 
v.ariety of experimenters are used. Informal observations suggest that not 
all trainees responded equally positively to this condition. Trainee 
characteristics probably interact t^ith experimenter characteristics, and 
such interactions probably influence differentially the effects of feed- 
back and cue discrimination training. 

Equally interesting Is the relative ineffectiveness of the self-feed- 
back condition, attractive because it is the least costly procedure. Tnls 
method is probably ineffective because the desired response is not adequate 
cued. Even if trainees had a limited response repertoire of reinforcing 
responses, they still could have used them consistently if somewhat 
monotonously. But, the rate increase is not likely to octur if the trainee 
does not "know" when to emit the desired response. Both of the other feed- 
bacx conditions cue as to appropriate response in some form. 

This St; If -feedback condition might be improved by introducing some 
cueing procedures. Or, a combination of viewing models and self might be 
effective. The results obtained in this experiment indicate only that a 
limited kind of self-viewing, presumed to be a self-feedback condition 
and designed to be so, is not highly effective in producing behavior change. 

The results of this experiment suggest that the operant conditioning 
model may be extended to situations in which the learner is not actually 
behaving but merely watching his performance after the actions have 
occurred. This extrapolation, if further substantiated, greatly increases 
the application of this particular paradigm. However, further research 
must also be directed to an analysis of the viewing conditions — 
characteristics of the persons viewing, time interval between enacting and 
viewing, the kind of behavior being reinforced, and similar conditions 
which might reasonably be expected to enhance or to emir the effects of 
the reinforcement procedure. 

Also of theoretical interest is the possibility of modifying the 
operant conditioning paradigm by instructing subjects. This procedure 
shortens the time and cost of shaping the desired behavior through s 
senes of successive approximations. The learning paradigm of this 
arrangement needs explication and analysis. 




TABLE 1 
(Exp. I) 

MEAN AGE AND FREQUENCY DISTRIBUTIONS FOR SEX, 
GRADE-LEVEL TAUGHT, AND SUBJECT-MAJOR FOR 

EACH EXPERIMENTAL GROUP 
N « 71 




II 






U 

iJ d 

a 

« e 

< 



w 

M 

M 

g 

e» 

Cr4 

s 

0 

H 

1 

03 

H 

P!! 

O 



fa 

1-9 

M 

CO 

b« 

o 




I 



er|c 



TABLE 3 
(Exp. I) 

INTERRATER RELIABILITY FOR SIX RATERS 
ON THE MAJOR RESPONSE CATEGORIES 
OF THE DEPENDENT VARIABLE 



Response Category 


Kendall Coefficient of 
Concordance: W 


Positive Verbal Reinforcement 


1.00 


Positive Non-Verbal Reinforcement 


0.99 


Negative Verbal Reinforcement 


1.00 


Negative Non-Verbal Reinforcement 


0.87 


Total Pupil Responses 


0.97 




TABLE 4 
(Exp. I) 



NUMBER OF VIDEOTAPES OMITTED 
AND PRORATED BEFORE STATISTICAL ANALYSIS 
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il 1 


Trial 2 


Trial 3 


J 

j Trial 4 

♦ 


TOTALS 


Group 


P 


0 


P 


1 " 


P 


i ° 


P 


0 


Prorate 


Omit 


1 (C) 


2 


1 

2 


1 

2 


2 


1 


0 


2 


1 


7 


5 j 


2 (S-F) 


3 


2 


4 


1 


3 


0 


1 


2 


11 


5 


3 (R) 


6 


1 


1 


1 


5 


1 


6 


4 


18 


7 


4 (R + D) 


4 


4 


2 


2 


4 


1 


5 


1 


15 


8 


TOTALS 


15 


9 


9 


6 

1 


13 

► 


2 


i 

14 


8 


51 

1 

• 


25 




TABLE 



5 



(Exp. I) 

SUMMARY OF THE ANALYSES OP COVARIANCE 
FOR THE EXPERIMENTAL GROUPS, WITH TRIAL ONE SCORES 
AS COVARIAKTS AND TEACHER POSITIVE VERBAL AND NON-VERBAL 
REINFORCEMENTS AS THE DEPENDENT VARIABLES 





Group 1 (C) 


Group 2 (S-F)|gtoup 3 (R)jGroup 4 ^+D) 


df 


F 


Adjusted Means and Standard Errors 


verbal 
Trial 2 


30.51 

A.i678 


30.18 

4.3160 


45.18 

4.2841 


60.93 

4.2532 


3/60 


11.884*iW 


non-verbal 


11.50 

3.1517 


9.39 

3.0566 


13.54 

2.9530 


122.13 ^ 

1 2.9556 


3/60 


3.482* 


verbal 
Trial 3 


22.16 

4.6586 


25.11 

4.3512 


40.53 

4.3272 


53.12 

4.3065 


3/59 


10.846** 


•m 

non-verbal 


13.69 

3.2773 


7.11 i 

3.0845 


'12.44 

2.9739 


14.7709 

2.9929 


3/59 


1.200 


verbal 
Trial 4 


31.42 

5.9130 


27.84 

5.9015 


32.26 

6.147 


51.67 

5.3842 


3/48 


3.721* 


j non-verbal 


6.26 

2.5389 


7.56 

2.5279 


9.56 

2.7565 


19.33 

2.2782 


3/48 
■ } 


6.315*** 



* .025 level of significance 

** .005 level of significance 

*** .001 level of significance 




TABLE 



6 



(Exp. I) 

SUmRY OF THE ANALYSES OF COVARIANCE FOR THE EXPERIMEl^'AL GROUPS, 
WITH TRIAL ONE SCORES AS COVARIANTS AND TEACHER NEGATIVE VERBAL AND 
NON-VERBAL REINFORCEMENTS AS THE DEPENDENT VARIABLE 





Group 1 (C) 


Group 2(S-F) 


Group 3 (R)|6roup 4 (R+D] 


df 


F 


Adjusted Means and Standard Errors 


verbal 
Trial 2 


5.15 

1.4149 


1.88 

1.3759 


5.53 

1.3392 


5.53 

1.3287 


3/60 


1.663^ 


non-verbal 


2.64 

0.6700 


1.61 

0.6515 


1.54 

0.6301 


1.09 

0.6304 


3/60 


0.990 


verbal 
Trial 3 


4.74 

1.5257 


5.37 

1.4327 


3.87 

1.3940 


6.06 

1.3838 


3/59 


0.446 


non-verbal 


1.51 

0.5384 


1.07 

0.5054 


0.58 

0.48S7 


1.81 

0.4899 


3/59 


1.184 


verbal 
Trial 4 


6.24 

1.5001 


3.33 

1.5041 


2.59 

1 . 6400 


3.25 

1.3518 


3/48 


1.148 


non-verbal 


1.57 

0.5060 


0.94 

0.5127 


0.84 

0.5491 


0.75 

0.4623 


3/48 


0.535 



.250 level of significance 




I 



TABLE 7 
(Exp. I) 

SIGNIFICANCE OF DIFFERENCES FOR THE FOUR EXPERIMENTAL GROUPS 
FROM TRIAL TO TRIAL, ON MAJOR RESPONSE CATEGORIES 
OF THE DEPENDENT VARIABLE* 



Response 

Category 


Group 1 (Control) 


Group 2 (S-F) 


Group 3 (R) 


Group 4 (R+D) 


Direction of Difference from Trial to Trial and 
Level of Significance 


+VR 


NS 


NS 


Tj<T 2 (. 01 ) 
T^<Tj (.05) 


(. 01 ) 
T^<T^ (. 10 ) 


+NVR 


NS 


NS 


NS 


TjCTy (. 10 ) 


-VR 


NS 


NS 


NS 


NS 


-NVR 


NS 


Tj vTj (. 10 ) 
Tj> T 4 (. 10 ) 


T^<I^ (.05) 
T,<T 2 (.05) 


(. 10 ) 

1 



♦Significance levels were tested by the T statistic for comparisons 
among treatment means (Winer, 1962, pp. 65-70). 



ERLC 



I 



1 



TABLE 8 
(Exp. I) 



SUMKARY OF THE AHALTSES OP COFARIAHCE FOR THE EXFERDfERrAL GROUPS, 
^TITH TRIAL ONE SCORES AS COVARIAMTS AMD TOTAL STUDENT 
RESPONSES AS THE DEPENDENT VARIABLE 





Group 1 (C) 


Group 2 (S-F) | 


1 Group 3 (R) 1 Group 4 (R4D) 


1 " 


F 

f 


Adjusted Means and Standard Errors 


Trial 2 


72.59 

5.5354 


47.39 

5.2296 


65.93 

5.3014 


83.29 

5.1161 


3/60 


8.267***! 

f 


Trial 3 


58.97 

6.6169 


54.26 

6.0530 


60.06 

6.3019 


84.31 

5.9179 


3/59 


t 

5.082** ! 


Trial 4 


61.40 

6.9336 


51.37 

7.0353 


52.65 

7.8020 


80.64 

6.5346 


3/48 


• 

3.913* 1 

i 



* .05 level of signiflcaoce 

** .01 level of significance 

*** .001 level of significance 
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TABLE 9 
(Exp. I) 



SUIMARY OF THE ANALYSES OF COVARIANCE FOR THE EXPERIMENTAL GROUPS 
WITH TRIAL ONE SCORES AS COVARIANTS AND TOTAL STUDENT VOLUNTARY 
STATEMENTS AS THE DEPENDENT VARIABLE 





Group 1 (C) 


i Group 2 (S-F) 


Group 3 (R) 


[croup 4 OMD) 


d£ 


P I 




Adjusted Means and Standard Errors 






Trial 2 


13.23 

2.4159 


5.98 

2.3169 


12.51 

2.2934 


17.31 

2.2522 


3/60 


4.184** 


Trial 3 


10.14 

2.3562 


8.20 

2.1965 


10.95 

2.1850 


15.10 

2.1588 


3/59 


1.786* 


Trial 4 


12.27 

2.3098 


7.39 

2.3056 


8.80 

2.5336 


17.41 

2.0725 


3/48 


4.159** 



250 level of significance 
^ «01 level of significance 




TABLE 10 
(Exp. I) 



INTERCORRELATION HATRIX FOR THE HAJOR RESPONSE CATEGORIES 

OF THE DEPENDENT VARIABLE 



Response Category 


TPR 


DSl 


DSG-l| 


DSG-\ 


h 


+VR 1 


|4NVR 


-VR 


-NVR 


1 


2 


3 1 


4! 


|5 


6 


7 


8 


9 


Total Pupil Responses (TPR) 1 


1.00 


0.56 


0.09 


0.41 


0.56 


0.50 


0.16 


0.45 


0.07 


Teacher Question to Individual » 
Pupils fDSn 




1.00 


0.08 


0.13 


0.07 


1 

0.33I 


1 

|o.03 


0.22 


0.02 


Question to Class , then to ^ 

one Individual (DSC- I) 






1.00 


— " r ■■ 
CM 

o 

• 


0.13 


O.Osjo.02 

1 


0.02 


-0.03 


Question to Class , then a , 

pupil Volunteer (DSG-V) 








1.00 


0.14 


0.24 


0.17 


0.11 


0.10 


Volunteer Statenent by - 

Pupils m ^ 










1.00 


0.46 


0.23 


0.20 


0.007 


Teacher Positive Verbal . 

Reinforcement (4VR) 












1.00 


0.44 


0.14 


0.007 


Teacher Positive Non-Verbal . 

Reinforcement (4N7R) ^ 














1.00 


0.02 


0.14 


Teacher Negative 
Reinforcement (-VR) 
















1.00 


0.15 


Teacher Negative Non-Verbal ^ 

(Reinforcement (-NVR) ^ 1 


1 






• 










1.00 




Fre.c(uency of Positi^ Rfiinforceraent 
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frequencies of teacher positive verbal and 
four^riats treatnent groups c 



over 




Mean Frequency of Negative Reirforcement 
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O Group 2 
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Teaching Sessions 

FIGURE 2. Unadjusted mean frequencies of teacher negative verbal and non-verbal 
reinforcGinent in each of the four trestioent groups over four trials* 
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FIGURE 3. Unadjusted mean frequencies of total pupil responses in each of the 
four treatment groups over four trials. 
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Teaching Sessions 



FIGURE V, Unadjusted mean frequencies of volunteered pupil statements for each 
of the tour treatment groups over four trials. 
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Teaching; Sessions 



riGURE 5. Proportion o£ pupil Initiated responses in relation to combined teaoiu 
and pupil initiated responses for each of the four treatment groups over four 

trials. 
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Teaching Sessions 

FIGURE 6. Unadjusted mean frequencies of teacher-specified and pupil volunteered 
responses as they vary from trial one to trial four for the control group and the 
maximum treatment group. 




